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Abstract 

Background: Medical work capacity evaluations play a key role in social security schemes because they usually 
form the basis for eligibility decisions regarding disability benefits. However, the evaluations are often poorly 
standardized and lack transparency as decisions on work capacity are based on a claimant's disease rather than on 
his or her functional capacity. A comprehensive and consistent illustration of a claimant's lived experience in 
relation to functioning, applying the International Classification of Functioning, Disability and Health (ICF) and the 
ICF Core Sets (ICF-CS), potentially enhances transparency and standardization of work capacity evaluations. In our 
study we wanted to establish whether and how the relevant content of work capacity evaluations can be captured 
by ICF-CS, using disability claimants with chronic widespread pain (CWP) and low back pain (LBP) as examples. 

Methods: Mixed methods study, involving a qualitative and quantitative content analysis of medical reports. The 
ICF was used for data coding. The coded categories were ranked according to the percentage of reports in which 
they were addressed. Relevance thresholds at 25% and 50% were applied. To determine the extent to which the 
categories above the thresholds are represented by applicable ICF-CS or combinations thereof, measures of the 
ICF-CS' degree of coverage (i.e. content validity) and efficiency (i.e. practicability) were defined. 

Results: Focusing on the 25% threshold and combining the Brief ICF-CS for CWP, LBP and depression for CWP 
reports, the coverage ratio reached 49% and the efficiency ratio 70%. Combining the Brief ICF-CS for LBP, CWP and 
obesity for LBP reports led to a coverage of 47% and an efficiency of 78%. 

Conclusions: The relevant content of work capacity evaluations involving CWP and LBP can be represented by a 
combination of applicable ICF-CS. A suitable standard for documenting such evaluations could consist of the Brief 
ICF-CS for CWP, LBP, and depression or obesity, augmented by additional ICF categories relevant for this particular 
context. In addition, the unique individual experiences of claimants have to be considered in order to assess work 
capacity comprehensively. 
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Background 

Even though the process of disability evaluation varies 
between countries, medical work capacity evaluations 
usually play a crucial role in deciding on a claimant's eli- 
gibility for benefits provided by national disability insur- 
ance schemes. Because of the key role they play, such 
evaluations ought to be transparent and comprehensible 
for all persons involved [1-4]. To enhance transparency 
and comprehensibility, the claimant's lived experience in 
relation to his or her functioning as well as with regard 
to influencing contextual factors should be assessed 
comprehensively [2,5]. Moreover, the evaluations' com- 
parability in terms of both interrater reliability between 
medical experts and content validity is considered as an 
important quality criterion [6-8]. Finally, standardization 
is seen as one means to ensure comparability in disabil- 
ity assessments [9,10]. 

Medical standards usually refer to features which are 
considered as relevant to a target group in general and 
less so to individuals' unique experiences [11,12]. As a 
basis for comprehensive disability evaluations, however, 
a suitable standard should also allow the description of 
relevant experiences unique to the individual, thus com- 
plementing the whole process of evaluation [12]. 

In reality, decisions on work capacity often lack trans- 
parency and comprehensibility [10,13-15]. Also, disabil- 
ity assessments are often insufficiently standardized 
[5,16,17], which affects their content validity and interra- 
ter reliability negatively [8,9,17]. In the Swiss national 
disability insurance scheme, for example, there is no 
generally accepted tool to guide the structure and con- 
tent of disability evaluations [3]. Furthermore, decisions 
on work capacity for certain disorders are partly based 
on blanket rulings by the Swiss Federal Court [3]. Soma- 
toform pain disorders, for instance, do generally not lead 
to incapacity for work. Because they are considered to 
be caused by psychosocial factors, the Swiss Social Se- 
curity law does not recognize them as a sufficient reason 
for a disability pension, except if they are accompanied 
by a psychiatric co-morbidity like, for example, a depres- 
sive disorder [18]. By contrast, pain disorders caused by 
structural impairments (e.g. by a severe intervertebral 
disc disorder) normally entitle a person to receive dis- 
ability benefits. However, diagnoses or impairments, are 
only loosely connected with functional limitations at 
work [19-21], Moreover, the World Health Organization 
defines impairment as a loss or abnormality of a psycho- 
logical, physiological, or anatomical structure or function 
and disability as a restriction or lack of ability to per- 
form an activity in a manner considered to be normal 
for a human being [22]. Based on these definitions, fo- 
cusing only on impairments is not sufficient to give a 
proper statement about a claimant's functional capacity 
at work. 



Because pain is a subjective sensation, its impact on a 
claimant's functional capacity is difficult to objectify. 
Claimants with somatoform pain disorders could have 
the same or even a lower functional capacity than per- 
sons with a disorder related to a structural impairment. 
Nevertheless, according to Swiss jurisprudence their 
work capacity is usually rated higher. With respect to 
this controversy between the medical and the legal view, 
it seems crucial to apply a disability-oriented approach 
and to comprehensively assess the aspects which might 
influence a claimant's functioning and health in order to 
ensure transparent disability evaluations for persons with 
chronic pain. 

Several attempts have been undertaken to enhance 
transparency and standardization in disability evalua- 
tions [23]. The Guides to the Evaluation of Permanent 
Impairment of the American Medical Association 
(AMA) are used for disability and impairment assess- 
ment and as a standard for workers' compensation eva- 
luations in the United States and many English-speaking 
countries [24]. Furthermore, a number of standardized 
procedures for work capacity assessments have been 
developed like, for example, the Functional Capacity 
Evaluation (FCE) [25-27]. 

FCE, however, is not appropriate for multidisciplinary 
assessments as it is not geared towards a comprehensive 
evaluation of the claimant's functioning. It focuses on 
physical functional limitations and not on mental func- 
tioning [25], and it does not address environmental fac- 
tors, an important component to ensure transparency in 
disability evaluations [5,28]. The AMA Guides have been 
questioned regarding their applicability in disability 
assessments of claimants with chronic pain [1], because 
they follow a diagnosis-based and impairment-oriented 
rather than a disability-oriented approach [29]. 

As part of the shift in recent years from impairment- 
oriented to disability-oriented assessments in European 
social security institutions, it has been suggested that the 
comprehensive conceptual framework and standardized 
taxonomy of the International Classification of Function- 
ing, Disability and Health (ICF) [30] could improve the 
disability determination process [16,31-33]. Since the 
ICF offers a scientific basis for describing results 
and determinants of functioning, disability and health 
which also considers contextual factors [30], stand- 
ardization and transparency in disability evaluations 
might be enhanced if the taxonomy would be used as a 
blueprint. 

While the ICF framework was generally well-received, 
the actual application of the taxonomy has been ham- 
pered by the sheer number of categories to be assessed, 
i.e. 362 on the second level and up to 1,424 when apply- 
ing the more detailed third and fourth levels. Conse- 
quently, ICF Core Sets (henceforth ICF-CS) have been 
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developed in order to simplify the use of the taxonomy 
in clinical settings. 

ICF-CS preserve the model of the ICF in a useable 
mode, and they come in two flavors: (1) brief ICF-CS in- 
clude a minimum number of categories describing the 
most relevant aspects related to functioning in persons 
with a specific health condition or in a specific setting 
[34]; (2) comprehensive ICF-CS include all categories of 
the respective brief ICF-CS but also additional ones so 
as to facilitate multidisciplinary assessments in the clin- 
ical context [35]. 

Because they involve high costs and time resources of 
medical experts are limited, medical work capacity eva- 
luations should not only be transparent but also effi- 
cient and practical [36]. ICF-CS allow to describe a 
persons lived experience in a comprehensive and sys- 
tematic way [35], and might be applied as practical 
standards regarding what should be documented in 
disability assessments. So far there have been only 
few attempts to examine the applicability of ICF-CS 
in disability evaluations [16,37]. To ascertain their po- 
tential it is, therefore, vital to provide further empirical 
evidence. 

Currently ICF-CS exist for about 30 health conditions 
[38]. The ICF-CS for chronic widespread pain (CWP) 
[39] and low back pain (LBP) [40] were published in 
2004 and subsequently validated in the clinical context 
[41-43]. Due to the high prevalence of disability claims 
and large social costs based on CWP and LBP [44-47], 
we chose them as our index conditions. Both conditions 
are also often diagnosed concurrently [48]. 

Moreover, CWP has been found to be related to de- 
pression [49] and chronic LBP to obesity [50]. Such co- 
morbidities are routinely addressed in disability assess- 
ments of claimants with chronic pain. We, therefore, 
also included in our analysis the ICF-CS for depression 
[51] and obesity [52]. 

Objective 

The objective of the study was to establish whether or 
not and how the relevant content of medical work cap- 
acity evaluations can be captured by ICF-CS, using med- 
ical reports from disability claimants with the index 
conditions CWP and LBP as examples. 

Specific aims 

(1) We wanted to examine to what extent the relevant 
aspects of functioning and environmental factors in 
medical reports of claimants with CWP and LBP are 
represented by applicable ICF-CS. (2) We wanted to de- 
termine by which ICF-CS, or combinations thereof, 
these aspects are best represented. 



Methods 

Study design 

A mixed methods study [53] was conducted, involving a 
qualitative and quantitative content analysis [54,55] of 
medical reports. The ICF was used for data coding. 

Ethics 

The study was approved by the Ethics Commission of 
Basel, Switzerland, project number 134/08, and was per- 
formed in accordance with the Declaration of Helsinki. 

Sample 

The reports analyzed were derived from an elicitation of 
all medical reports received by the major Swiss health 
and accident insurers between February 1 and April 31, 
2008, as part of a study on the quality of medical work 
capacity evaluations in Switzerland [3]. Insurance 
employees selected and anonymized all reports contain- 
ing a diagnosis of CWP and/or LBP based on the Inter- 
national Classification of Diseases (ICD-10) (see 
Table 1). The diagnoses were checked by two health pro- 
fessionals. To ensure comparability, only reports in 
German submitted to the Swiss national disability 
insurance scheme were selected. Reports in French and 
Italian as well as from accident, health and liability 
insurances were excluded. 

From this basic sample a subsample was randomly 
drawn. The determination of the final sample size was 
based on two criteria: (1) heterogeneity, i.e. the relevant 
medical disciplines of pain-assessment and the index 
conditions (CWP, LBP) were to be included proportion- 
ally; and (2) saturation, i.e. the collected information 
was considered to be sufficient when no new second- 
level ICF category emerged in five successive reports 
analyzed [56-58]. In order to satisfy the heterogeneity re- 
quirement, i.e. a proportional inclusion of the medical 
disciplines and the index conditions, a minimum size of 
the subsample was determined. 

Analysis plan 

For the data analysis the sample was divided into two 
sub-groups: (1) reports with CWP diagnoses, and (2) 
reports with LBP diagnoses. Reports including both 
diagnoses entered the data analysis twice, once with the 
pure CWP and once with the pure LBP reports. 

To examine the extent to which the relevant aspects 
of functioning and environmental factors in medical 
reports of claimants with CWP and LBP are represented 
by applicable ICF-CS, we first did a content analysis of 
the reports, using the ICF for data coding. We then 
ranked the coded categories for both sub-groups accord- 
ing to their relevance, i.e. their relative frequency across 
reports, setting thresholds at 25% and 50%. Next, we 
examined whether the relevant ICF categories in CWP 
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Table 1 ICD-10 diagnoses included in the sample 



ICD-10 diagnoses for CWP 

F45.0 Somatization disorder 

F45.1 Undifferentiated 

somatoform disorder 

F45.4 Persistent somatoform 
disorder 

F54 



F62.8 Chronic pain personality 
syndrome 

F32 Mild, moderate and severe 
depressive episode, with 
somatic symptoms 

F33 Recurrent depressive 
disorder, with somatic 
symptoms 

F34.1 Dysthymia (in relation with 
pain) 

F43.2 Adjustment disorders 



M79.7 Fibromyalgia 
R52.2 Other chronic pain 



ICD-10 diagnoses for LBP 

M42 Spinal osteochondrosis 
(.15-17, .95-97) 

M45 Ankylosing spondylitis 

M46 Other inflammatory 

spondylopathies (.0, .1, .2, .3) 



M48 Other spondylopathies 
(.05-07, .15-17, .25-27) 

M51 Other intervertebral disc 
disorders (.0, .1) 

M53 Other dorsopathies, not 

elsewhere classified {25-27, 
.3, .86-87, .96-97) 

M54 Dorsalgias (.05-07, .15-17, 
.3, .4, .5, .85-87) 

M99 Biomechanical lesions, not 
elsewhere classified (.03, .13, 
.23, .33, .43, .53, .63, .73, 
.83, .93) 



Psychological and 
behavioral factors associated 
with disorders or diseases 
classified elsewhere 



M47 Spondylosis and 

(osteo-)arthrosis of spine 
(.05-07, .15-17, .25-27) 



R52.9 Pain, unspecified 



reports, i.e. the ones above the thresholds, are repre- 
sented by the ICF-CS for the index condition (CWP) 
and major co-morbidities (LBP, depression). For LBP 
reports, we did the same analysis with the ICF-CS for 
the index condition (LBP) and major co-morbidities 
(CWP, obesity). By calculating and comparing values for 
their coverage (i.e. their content validity) and efficiency 
(i.e. their potential practicability) we determined to what 
extent the relevant aspects in the reports are represented 
by the ICF-CS for the index-condition, the co-morbidities, 
and a combination thereof and which ICF-CS or combin- 
ation thereof is best representing these aspects. 

Analysis 
Content analysis 

Our raw data consisted of reports on disability clai- 
mants. They comprised one or more medical disciplines 
and included information on: (a) socio-medical history, 
(b) medical examination, and (c) work capacity evalu- 
ation. This content was coded to the ICF by applying 
established linking rules [59,60] . 

The reports were dissected into text passages, each 
representing a self-contained unit of meaning (e.g. "the 
claimant suffers from pain while walking"). The various 
concepts underlying a unit of meaning were determined 



(e.g. pain, walking) and coded to the most precise ICF 
category (e.g. b280 Sensation of pain, d450 Walking) by 
two health professionals trained in the ICF. A concept 
could be linked to more than one ICF category. Each in- 
stance of a category code being assigned to a concept 
was referred to as a coding. Concepts not appropriately 
codeable to ICF categories were flagged as either per- 
sonal factors (e.g. individual attitudes and beliefs), not 
covered (e.g. degree of disability), not definable (e.g. 
demanding activities), or health condition (e.g. diabetes). 
The two coders assessed whether the categories repre- 
sented limitations (e.g. "the claimant suffers from back 
pain") or, in case that they were environmental factors, 
whether they were barriers (e.g. "the surgery made the 
pain worse") or facilitators (e.g. "the surgery was help- 
ful") for the claimant, were no problem (e.g. "the surgery 
had no effect"), or facts (e.g. "the surgery was performed 
recently"). Finally, the coders had to agree on the chosen 
codes. Any disagreement was solved in consultation with 
a third person experienced in the linking method. 

Reliability and saturation 

The interrater agreement was calculated using Cohens 
kappa coefficient [61]. The saturation level was checked 
after each additional report analyzed. 

Relevance ranking 

Referring to the absolute frequency for determining rele- 
vance was deemed potentially misleading because differ- 
ent writing styles of medical experts could have led to 
varying degrees of content repetitions. Therefore, we 
operationalized the relevance of a coded category as its 
relative frequency across reports, i.e. the percentage of 
reports in which it appeared as a limitation, barrier or 
facilitator for the claimant. In order to ensure compar- 
ability with the ICF-CS, which refer to aspects that are 
problematic or supportive for the patients, we did not 
include the ICF categories assessed as no problem or 
facts in the ranking. Moreover, since the concepts not 
appropriately codeable with the ICF were not further 
specified in this study, they were not included in the 
ranking. Thus, the final ranking involved only second- 
level ICF categories coded either as a limitation, barrier 
or facilitator. For the ensuing data analysis we defined 
two thresholds of minimum relevance, the more lenient 
one at 25% or more of the reports, the more stringent 
one at 50% or more. 

Coverage and efficiency ratios 

We used two criteria to examine the extent to which the 
relevant content of medical reports involving CWP and 
LBP is represented by ICF-CS. (1) The coverage ratio, i.e. 
the ability of ICF-CS to capture the relevant aspects of 
the context in which they are applied (namely the index 
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Note: Q = all domains of human experience; R = content of medical reports; I = all 362 
second-level ICF categories; C = Comprehensive ICF Core Set categories (for CWP or LBP); B = 
Brief ICF Core Set categories (for CWP or LBP). 
Figure 1 Operationalization of an ICF Core Set's coverage and efficiency ratios. 



conditions CWP and LBP and the assessment of work 
capacity as part of disability evaluations). It was calcu- 
lated as the number of ICF-CS categories above the 
threshold of 25% (or 50%) divided by the total number 
of ICF categories above the threshold. (2) The efficiency 
ratio, i.e. the ability of ICF-CS to be manageable and to 
contain only as many categories as necessary. It was cal- 
culated as the number of ICF-CS categories above the 
threshold divided by the total number of categories in 
the ICF-CS. A definition of efficiency which is similar to 
ours was applied in a recent study where it was defined 
as the ability of a measurement instrument to be man- 
ageable and to contain as few items as possible that 
measure variables outside a domain set of ICF categories 
used in that study [62] . 

ICF-CS should ideally show a high coverage ratio and 
be efficient at the same time. 

Referring to Figure 1, the operationalization of the 
coverage and efficiency ratios can be further illustrated 
as follows: 

Coverage ratio (Brief ICF-CS) = (B D R)/(I D R) 
Coverage ratio (Comprehensive ICF-CS) 

= (cnR)/(inR) 

Efficiency ratio (Brief ICF-CS) = (B n R)/B 
Efficiency ratio (Comprehensive ICF-CS) 

= (cnR)/c 



Results 

Sample characteristics 

In order to satisfy the heterogeneity requirement, the 
required minimum sample size had been determined to 



be 72 medical reports, representing about one third of 
the basic sample of 209 reports. The saturation criterion 
was already reached after coding 30 reports. The num- 
ber and type of disciplines in the reports are displayed in 
Table 2. 

27 reports contained only a CWP diagnosis, 22 
only a LBP diagnosis, and 23 both a CWP and LBP diag- 
nosis. Of the 50 reports with CWP diagnoses, 24 (48%) 
also included a diagnosis of the ICD-10-four-character 
subcategory "Mood [affective] disorders". Of the 
45 reports with LBP diagnoses, 13 (29%) additionally 

Table 2 Medical disciplines represented in the reports 

CWP LBP 

Number of medical disciplines in report 

One 20 14 

Two 4 5 

More than two 26 26 
Medical discipline 

Psychiatry 45 31 

Rheumatology 21 22 

Internal medicine 16 16 

Neurology 10 11 

Orthopedics 9 12 

General medicine 1 1 9 

Neurosurgery 1 5 

Orthopedic surgery 1 3 

Neuropsychology 1 3 

Pneumology 1 

Hand surgery 1 1 

Functional capacity evaluation - 1 
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Table 3 Relative frequency ranking of the ICF categories found in the CWP reports (n = 50) 

CWP LBP Depression Relative Absolute 

Brief Compr. Brief Compr. Brief Compr. frequency 

(k=24) (k=67) (k=35) (k=78) (k=31) (k=121) (/o) 



1 


b280 


Sensation of pain 


X 


X 


X 


X 




X 


100 


2531 


2 


b152 


Emotional functions 


X 


X 


X 


X 


X* 


X 


98 


640 


3 


b130 


Energy and drive functions 


X 


X 


X 


X 


X* 


X 


98 


393 


4 


d850 


Remunerative employment 


X 


X 


X 


X 




X 


96 


344 


5 


b126 


Temperament and personality functions 




X 




X 


X* 


X 


94 


445 


6 


b134 


Sleep functions 


X 


X 


X 


X 




X 


92 


222 


7 


e310 


Immediate family 


X 


X 


X 


X 


X 


X 


90 


332 




el lOt 


Products or substances for personal consumption 


X* 


X* 


X 


X 


X* 


X* 


90 


184 


8 


e580 


Health services, systems and policies 




X 


X 


X 


X 


X 


88 


106 


9 


d240 


Handling stress and other psychological demands 


X 


X 


X 


X 


X 


X 


86 


177 


10 


d570 


Looking after one's health 




X 




X 


X 


X 


86 


154 


11 


b270 


Sensory functions related to temperature and other 
stimuli 




X 










82 


225 


12 


el 101 


Drugs 


X 


X 


X* 


X* 


X 


X 


82 


140 




b160t 


Thought functions 


X* 


X* 








X 


80 


337 


13 


b730 


Muscle power functions 


X 


X 


X 


X 






78 


180 


14 


b710 


Mobility of joint functions 




X 


X 


X 






74 


365 


15 


b1602 


Content of thought 


X 


X 








X 


74 


145 


16 


e570 


Social security services, systems and policies 


X 


X 


X 


X 




X 


74 


130 


17 


s760 


Structure of trunk 






X 


X 






70 


571 


18 


d415 


Maintaining a body position 




X 


X 


X 






70 


201 


19 


e165 


Assets 












X 


70 


89 


20 


d450 


Walking 


X 


X 


X 


X 






68 


141 


21 


d760 


Family relationships 


X 


X 


X 


X 


X 


X 


68 


103 


22 


d230 


Carrying out daily routine 


X 


X 






X* 


X 


68 


98 


23 


b435 


Immunological system functions 














64 


207 


24 


b735 


Muscle tone functions 




X 


X 


X 






64 


122 


25 


d430 


Lifting and carrying objects 


X 


X 


X 


X 






64 


104 


26 


b455 


Exercise tolerance functions 


X 


X 


X 


X 






64 


102 


27 


d870 


Economic self-sufficiency 












X 


64 


73 


28 


d920 


Recreation and leisure 


X 


X 




X 




X 


64 


66 


29 


d770 


Intimate relationships 


X 


X 




X 


X 


X 


62 


74 


30 


d410 


Changing a basic body position 




X 


X 


X 






58 


84 


31 


d750 


Informal social relationships 












X 


58 


53 


32 


s750 


Structure of lower extremity 








X 






56 


179 


33 


d845 


Acquiring, keeping and terminating a job 




X 


X 


X 


X 


X 


56 


68 


34 


b140 


Attention functions 




X 






X 


X 


56 


60 


35 


b147 


Psychomotor functions 


X 


X 






X 


X 


54 


80 


36 


b144 


Memory functions 












X 


52 


65 


37 


b530 


Weight maintenance functions 












X 


50 


86 


38 


e565 


Economic services, systems and policies 














48 


50 


39 


e410 


Individual attitudes of immediate family members 


X 


X 


X 


X 


X 


X 


46 


72 


40 


e225 


Climate 








X 




X 


44 


53 



Rank ICF ICF category 
code 
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Table 3 Relative frequency ranking of the ICF categories found in the CWP reports (n = 50) (Continued) 



41 


a/zu 


Complex interpersonal interactions 


Y 
A 








Y 
A 


44 


45 


42 


d 1 60 


Focusing attention 


V 
A 










44 


44 


43 


d475 


Driving 


X 




X 




X 


44 


38 


44 


b240 


Sensations associated with hearing and vestibular 
function 












42 


47 


45 


Do 1 U 


Protective functions of skin 












A 1 

4z 


jy 


46 


d445 


Hand and arm use 






X 






40 


56 


47 


D420 


Blood pressure functions 












40 


44 


48 


d350 


Conversation 








X 


X 


40 


32 


49 


b460 


Sensations associated with cardiovascular and 
respiratory functions 










X 


38 


44 


jU 


S/zU 


Structure of shoulder region 












3 Q 
JO 


4j 


51 


bl 10 


Consciousness functions 












38 


40 


52 


e325 


Acquaintances, peers, colleagues, neighbours and 
community members 


X 




X 


X 


X 


38 


28 


jj 


eo i j 


Extended family 












OD 


3 1 

5 I 


54 


d440 


Fine hand use 












34 


52 


55 


b620 


Urination functions 






X 






34 


42 


56 


b535 


Sensations associated with the digestive system 










X 


34 


34 


57 


e120 


Products and technology for personal indoor and 
outdoor mobility and transportation 






X 






32 


67 


jo 


ao4u 


Doing housework X 


Y 
A 


Y 
A 


Y 
A 




Y 
A 


51 


5d 


c:q 

_>y 


ez4j 


Time-related changes 










Y 
A 


5 A 


1 c: 
JJ 


DU 


D/oU 


Sensations related to muscles and movement 
functions 


Y 
A 




Y 
A 




Y 
A 


51 


JJ 


61 


D415 


Blood vessel functions 












32 


31 


62 


b510 


Ingestion functions 












32 


24 


63 


d166 


Reading 










X 


32 


16 


64 


b525 


Defecation functions 












30 


33 


65 


b770 


Gait pattern functions 






X 






30 


31 


66 


s740 


Structure of pelvic region 






X 






30 


30 


67 


d660 


Assisting others 


X 




X 




X 


28 


27 


68 


S120 


Spinal cord and related structures 




X 


X 






28 


27 


69 


b750 


Motor reflex functions 






X 






28 


26 


70 


d540 


Dressing 


X 


X 


X 




X 


28 


25 


71 


e355 


Health professionals X 


X 


X 


X 


X 


X 


28 


23 


72 


d455 


Moving around 


X 




X 






28 


20 


73 


e320 


Friends 








X 


X 


28 


18 


74 


d740 


Formal relationships 












26 


33 


75 


b164 


Higher-level cognitive functions 


X 








X 


26 


25 


76 


D830 


Other functions of the skin 












26 


20 


77 


S730 


Structure of upper extremity 












24 


45 


78 


e430 


Individual attitudes of people in positions of authority 


X 








X 


24 


37 


79 
80 


d460 
e510 


Moving around in different locations 

Services, systems and policies for the production of 
consumer goods 






X 






24 
24 


27 
24 


81 


d710 


Basic interpersonal interactions 






X 




X 


24 


23 
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Table 3 Relative frequency ranking of the ICF categories found in the CWP reports (n = 50) (Continued) 



82 


d950 


Political life and citizenship 










Y 
A 




91 
z I 


83 
84 


b640 
el 1 5 


Sexual functions 

Products and technology for personal use in daily 
living 


X 




v 

A 




v 
A 


24 
24 


20 
19 


85 
86 


d330 
s320 


Speaking 

Structure of mouth 










X 


24 


19 

I O 


87 


d620 


Acquisition of goods and services 


X 




v 
A 




Y 
A 


1A 


1 A 


Ranking of the remaining categories of the Brief ICF Core Sets for CWP, LBP and depression: 












92 


b740 


Muscle endurance functions 


X 


X 


X 






22 


17 


yj 

98 


e135 


IMUIVIUUdl dllllUUcb Ul Ileal LI I pi Ul ebblUI ldlb 

Products and technology for employment 


v 
A 


V 
A 

X 


X 
X 


X 


X 


20 
18 


14 
18 


99 


s770 


Additional musculoskeletal structures related to 
movement 


X 


X 


X 






18 


13 


100 


e550 


Legal services, systems and policies 




X 


Y 
A 






1 8 
I O 


1 1 
1 z 


103 


d859 


Work and employment, other specified and 
unspecified 




X 


Y 

A 






I O 


zU 


116 


d163 


Thinking 








X 


X 


14 


9 


117 


b760 


Control of voluntary movement functions 


X X 










14 


8 


121 


b715 


Stability of joint functions 




X 


X 






14 


7 


139 


e415 


Individual attitudes of extended family members 








X 


X 


8 


11 


161 


d530 


Toileting 




X 


X 






6 


4 


185 


d510 


Washing oneself 


X 




X 


X 


X 


4 


2 


210 


dl 75 


Solving problems 


X X 






X 


X 


2 


1 


212 


e420 


Individual attitudes of friends 


X 






X 


X 


2 


1 


221 


d177 


Making decisions 








X 


X 


2 


1 



Note: k = total number of categories in the respective ICF Core Set; t = ICF categories that were ignored in the ranking because the Brief and Comprehensive ICF 
Core Sets for CWP contain them on the more specific third level; X = included in the particular ICF Core Set (CWP, LBP or depression); * = in the particular ICF Core 
Set the stated category is included at the next lower (third) or next higher (second) level. 

involved a diagnosis related to "Obesity and other Table 3 shows if the categories are included in the ICF- 
hyperalimentation". CS for CWP, LBP and depression. 

The overall interrater agreement (Cohens kappa) at 
the second ICF-level was 0.80 (0.79 - 0.81; 95% boot- 
strap confidence interval [63]). 



Reports with CWP diagnoses 
Content analysis 

21,562 units of meaning gave rise to 45,365 (100%) cod- 
ings. 30,042 (66.2%) represented links to ICF categories. 
The remainder (15,323 or 33.8%), i.e. R/I in Figure 1, 
were not classifiable appropriately with the ICF. Of 
these, 4,276 (9.4%) codings represented personal factors, 
the as yet unspecified fifth component of the ICF. 4,094 
(9%) codings were labeled as not covered, 4,710 (10.4%) 

as not definable, and 2,243 (4.9%) as health condition. Reports with LBP diagnoses 



Coverage and efficiency ratios 

Focusing on the more inclusive 25% threshold, the rele- 
vant aspects of functioning and environmental factors in 
CWP reports are represented with a coverage of 29% 
[54%] and an efficiency of 92% [61%] by the Brief [Com- 
prehensive] ICF-CS for CWP (see Table 4). 

When combining the ICF-CS for CWP, LBP and de- 
pression, the coverage ratio of the Brief [Comprehensive] 
ICF-CS was with 49% [82%] substantially higher and the 
efficiency ratio with 70% [47%] lower compared to the 
ICF-CS for CWP. 



Content analysis 

21,707 units of meaning led to 42,116 (100%) codings. 
Relevance ranking 28,876 (68.6%) represented ICF categories. Of the 13,240 

76 ICF categories passed the 25% and 37 the 50% thresh- (31.4%) codings not classifiable appropriately with the 
old and were identified as relevant for CWP reports. ICF, 3,111 (7.4%) were labeled as personal factors, 3,322 
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Table 4 Coverage and efficiency ratios of the different 
ICF Core Sets for the CWP-reports (n = 50) and the two 
relevance thresholds 

Number of Coverage Efficiency 
overlapping ratio (%) ratio (%) 
categories 



92 
61 
83 
55 
73 
48 

70 

47 

79 
43 
60 
33 
54 
29 

55 

27 



Note: m = total number of ranked categories above the respective threshold; 
k = total number of categories in the respective ICF Core Set; t = categories 
aggregated on the second level (expect categories only available on the third 
level in the Comprehensive ICF Core Set); * = adjusted for overlap between the 
categories of the three ICF Core Sets. 



(7.9%) as not covered, 4,236 (10.1%) as not definable, and 
2,571 (6.1%) as health condition. 

Relevance ranking 

74 ICF categories passed the 25% and 33 the 50% thresh- 
old and were identified as relevant for LBP reports. 
Table 5 shows if the categories are included in the ICF- 
CS for LBP, CWP and obesity. 

Coverage and efficiency ratios 

Focusing on the 25% threshold, the relevant aspects of 
functioning and environmental factors in LBP reports 
are represented with a coverage of 36% [58%] and an ef- 
ficiency of 77% [55%] by the Brief [Comprehensive] ICF- 
CS for LBP (see Table 6). 

When combining the ICF-CS for CWP, LBP and 
obesity, the coverage ratio of the Brief [Comprehensive] 



ICF-CS was with 47% [80%] substantially higher and the 
efficiency ratio with 78% [41%] lower compared to the 
ICF-CS for LBP. 



Discussion 

We found that the relevant content of medical work 
capacity evaluations involving CWP and LBP can be 
captured to a considerable, albeit not perfect, extent by a 
combination of applicable ICF-CS. The relevant aspects 
of functioning and environmental factors in the reports 
were either represented by the ICF-CS for the index 
conditions (CWP, LBP) or for major co-morbidities (de- 
pression, obesity). In both groups of reports and for both 
relevance thresholds, a combination of the ICF-CS ana- 
lyzed showed substantially higher coverage ratios than 
the condition-specific ICF-CS, i.e. they represented the 
relevant aspects of medical work capacity evaluations in- 
volving CWP and LBP to a higher extent. There is, how- 
ever, a trade-off. Due to the increased number of 
categories when combining the ICF-CS, the efficiency 
ratios decreased considerably compared to the 
condition-specific ICF-CS in most cases. 

An interesting finding with regard to the medical dis- 
ciplines involved in the medical reports was that, in fact, 
psychiatry appeared in both groups of reports as the 
most frequent discipline. This clearly indicates the rele- 
vance of psychiatric assessments for multidisciplinary 
medical work capacity evaluations of persons with CWP 
and LBP and is also in line with the finding that a con- 
siderable percentage of our medical reports included a 
co-morbid disorder from the ICD-10 chapter "Mood 
[affective] disorders". 

Overall, our results are in line with previous research 
in the field which found that the Comprehensive ICF-CS 
for CWP and LBP have a potential for structuring work 
capacity assessments [37] . 

Our findings are also in agreement with the recently 
developed ICF Core Sets for vocational rehabilitation 
[64] regarding the importance of highlighting the com- 
ponents activities, participation and environmental fac- 
tors in the context of work and work capacity. 

Finally, with regard to the generic core set for disability 
evaluation in social security [32] we feel that its lack of 
environmental factors may be a potential limitation if 
one aims for a comprehensive and transparent docu- 
mentation of a claimants work capacity. While the 
authors argue that environmental aspects are implicitly 
covered by the participation items, we found in our ana- 
lysis of medical reports prepared in the context of dis- 
ability evaluations that a number of environmental 
factors (e.g. e310 Immediate family; el 65 Assets) are ex- 
plicitly and frequently reported as barriers or facilitators 
for the claimants (see Tables 3 and 5). 



Relevance threshold > 25% (m = 76) 

CWP Brief (k = 24) 22 29 

CWP Comprehensive (k = 67) 41 54 

LBP Brief (k = 35) 29 38 

LBP Comprehensive (k = 78) 43 57 

Depression Brief (k = 26t) 1 9 25 

Depression Comprehensive 43 57 
(k = 90t) 

CWP + LBP + Depression Brief 37 49 
(k = 53*) 

CWP + LBP + Depression 62 82 
Comprehensive (k= 131*) 

Relevance threshold > 50% (m = 37) 

CWP Brief (k = 24) 19 51 

CWP Comprehensive (k = 67) 29 78 

LBP Brief (k = 35) 21 57 

LBP Comprehensive (k= 78) 26 70 

Depression Brief (k = 26t) 1 4 38 

Depression Comprehensive 26 70 
(k = 90t) 

CWP + LBP + Depression Brief 29 78 
(k = 53t*) 

CWP + LBP + Depression 36 97 
Comprehensive (k= 131t*) 
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Table 5 Relative frequency ranking of the ICF categories found in the LBP reports (n = 45) 



Rank 


ICF 


ICF Category 


LBP 


CWP 


Obesity 


Relative 


Absolute 




Code 




Brief 

(k=35) 


Compr. 
(k=78) 


Brief 

(k=24) 


Compr. 
(k=67) 


Brief 

(k=8) 


Compr. 
(k=109) 


Frequency 

(%) 


Frequency 


1 


b280 


Sensation of pain 


x 


x 


x 


x 




x 


1 00 


2462 


Z 


r\A 1 ^ 


Maintaining a body position 


v 
A 


Y 
A 




Y 
A 




Y 
A 


1 nn 
I uu 


zoy 


o 

D 


S/oU 


Structure of trunk 


V 
A 


Y 
A 








Y 
A 


no 


yjo 


4 


b71 0 


Mobility of joint functions 


x 


x 




x 




x 


98 


490 


J 


(joju 


ncl 1 1UI Icl d Live cl I ipiOyl I Icl 1 1 


Y 
A 


Y 
A 


Y 
A 


Y 
A 




Y 
A 


Q1 
y I 


J/J 


O 


D/dU 


Muscle power functions 


Y 
A 


Y 
A 


Y 
A 


Y 
A 






y i 


I yz 


7 


Dz/U 


Sensory functions related to temperature and other 
stimuli 








x 






Q7 

o/ 


ZOU 


8 


d450 


Walking 


X 


X 


X 


X 


X 


X 


87 


158 


9 


b735 


Muscle tone functions 


X 


X 




X 






87 


119 


10 


b134 


Sleep functions 


X 


X 


X 


X 




X 


84 


157 


11 


d430 


Lifting and carrying objects 


X 


X 


X 


X 




X 


84 


151 


12 


d570 


Looking after one's health 




X 




X 


X 


X 


82 


122 


13 


b152 


Emotional functions 


X 


X 


X 


X 




X 


80 


446 


14 


b126 


Temperament and personality functions 




X 




X 




X 


80 


335 


15 


b130 


Energy and drive functions 


X 


X 


X 


X 


X 


X 


80 


277 


16 


d410 


Changing basic body position 


X 


X 




X 




X 


80 


111 


17 


el 10 


Products or substances for personal consumption 


X 


X 


X* 


X* 


X 


X 


78 


188 


18 


e580 


Health services, systems and policies 


X 


X 




X 




X 


76 


101 


19 


e310 


Immediate family 


X 


X 


X 


X 


X 


X 


73 


171 


20 


b435 


Immunological system functions 












X 


71 


171 


21 


e570 


Social security services, systems and policies 


X 


X 


X 


X 




X 


69 


97 


22 


s750 


Structure of lower extremity 




X 








X 


64 


275 


23 


b530 


Weight maintenance functions 










X 


X 


64 


81 


24 


e165 


Assets 














64 


57 


25 


b160 


Thought functions 






X* 


X* 






62 


202 


26 


d240 


Handling stress and other psychological demands 


X 


X 


X 


X 


X 


X 


62 


137 


27 


d920 


Recreation and leisure 




X 


X 


X 




X 


62 


73 


28 


d230 


Carrying out daily routine 






X 


X 






60 


90 


29 


b420 


Blood pressure functions 












X 


60 


40 


30 


d870 


Economic self-sufficiency 












X 


58 


55 


31 


d760 


Family relationships 


X 


X 


X 


X 




X 


56 


64 


32 


d845 


Acquiring, keeping and terminating a job 


X 


X 




X 




X 


53 


40 


33 


b455 


Exercise tolerance functions 


X 


X 


X 


X 




X 


51 


57 


34 


S720 


Structure of shoulder region 














49 


48 


35 


e225 


Climate 




X 








X 


47 


52 


36 


d445 


Hand and arm use 




X 










44 


49 


37 


b750 


Motor reflex functions 




X 










44 


43 


38 


d750 


Informal social relationships 












X 


44 


38 


39 


d455 


Moving around 




X 




X 


X 


X 


42 


38 


40 


d770 


Intimate relationships 




X 


X 


X 




X 


42 


35 


41 


b147 


Psychomotor functions 






X 


X 






40 


60 


42 


b770 


Gait pattern functions 




X 










40 


42 
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Table 5 Relative frequency ranking of the ICF categories found in the LBP reports (n = 45) (Continued) 



43 


b144 


Memory functions 












38 


61 


44 


e565 


Economic services, systems and policies 












38 


44 


45 


d440 


Fine hand use 












36 


50 


46 


b140 


Attention functions 








X 




36 


49 


47 
48 

A O 


e245 
s740 
b41 5 


Time-related changes 
Structure of pelvic region 
Blood vessel functions 




X 






Y 
A 


36 
36 

DO 


35 
34 

ZO 


jU 


qodu 


Conversation 












3A 
DO 


ZD 


51 


Do 1 U 


Protective functions of the skin 












DO 


DD 

ZZ 


kd 
dZ 


S I zU 


Spinal cord and related structures 


v 

A 


v 

A 








jj 


Dl 


^3 
jj 


UOZU 


uriridiiuii luiiLLiuiis 




v 
A 






v 
A 


JO 


ZD 


54 


S/oU 


Structure of upper extremity 












D I 


/ Z 


r r 
J J 


DZ4U 


Sensations associated with hearing and vestibular 
functions 












O 1 
D 1 


D I 


56 


d160 


Focusing attention 








X 




31 


35 


57 


d640 


Doing housework 


V 
A 


V 
A 


v 
A 


v 
A 


v 
A 


31 


30 


58 


d475 


Driving 




v 
A 




v 
A 


v 
A 


31 


29 


_>y 


d540 


Dressing 


Y 
A 


Y 
A 




Y 
A 


Y 

A 


o I 


Zl 


60 


b755 


Involuntary movement reaction functions 












31 


27 


61 


D715 


Stability of joint functions 


X 


X 








31 


26 


62 


d720 


Complex interpersonal interactions 








X 




31 


24 


63 


e325 


Acquaintances, peers, colleagues, neighbours and 
community members 




X 




X 


X 


31 


22 


64 


b525 


Defecation functions 












31 


20 


65 


e315 


Extended family 












29 


26 


66 


el 15 


Products and technology for personal use in daily 
living 










X 


29 


21 


67 


D535 


Sensations associated with the digestive system 










X 


27 


30 


68 


e410 


Individual attitudes of immediate family members 


X 


X 


X 


X 


X 


27 


25 


69 


b460 


Sensations associated with cardiovascular and 
respiratory functions 












27 


24 


70 


b780 


Sensations related to muscles and movement 
functions 




X 




X 




27 


23 


71 


b740 


Muscle endurance functions 


X 


X 




X 




27 


19 


72 


e430 


Individual attitudes of people in positions of authority 








X 




27 


18 


73 


b640 


Sexual functions 




X 




X 


X 


27 


15 


74 


d166 


Reading 












27 


15 


75 


e120 


Products and technology for personal indoor and 
outdoor mobility and transportation 




X 






X 


24 


62 


76 


b164 


Higher-level cognitive functions 








X 




24 


43 


77 


e510 


Services, systems and policies for the production of 
consumer goods 










X 


24 


26 


78 


bl 10 


Consciousness functions 












22 


20 


79 
80 


s320 
D755 


Structure of mouth 

Involuntary movement functions 












22 
22 


19 
18 


81 


d620 


Acquisition of goods and services 




X 




X 


X 


22 


13 


82 


s770 


Additional musculoskeletal structures related to 


X 


X 




X 


X 


22 


12 



movement 
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Table 5 Relative frequency ranking of the ICF categories found in the LBP reports (n = 45) (Continued) 

Ranking of the remaining categories of the Brief ICF Core Sets for LBP, CWP and obesity: 

89 e355 Health professionals X X X X . X 20 11 

92 d859 Work and employment, other specified and XX. ... 18 20 
unspecified 

94 el 35 Products and technology for employment X X . . . . 18 15 

103 e450 Individual attitudes of health professionals X X . X . X 16 13 

104 b760 Control of voluntary movement functions . . X X . . 16 13 

105 el 55 Design, construction and building products and X X . . . X 16 11 

technology of buildings for private use 

122 e550 Legal services, systems and policies X X . . . . 11 13 

201 d175 Solving problems ..XX.. 2 1 

d530 Toileting X X ... X 0 0 



Note: k = total number of categories in the respective ICF Core Set; X = included in the particular ICF Core Set (LBP, CWP or obesity); * = in the particular ICF Core 
Set the stated category is included at the next lower (third) or next higher (second) level. 



Table 6 Coverage and efficiency ratios of the different 
ICF Core Sets for the LBP-reports (n = 45) and the two 
relevance thresholds 

Number of Coverage Efficiency 
overlapping ratio (%) ratio (%) 
categories 

Relevance threshold > 25% (m = 74) 



LBP Brief (k = 35) 


27 


36 


77 


LBP Comprehensive (k= 78) 


43 


58 


55 


CWP Brief (k = 24) 


21 


28 


88 


CWP Comprehensive (k = 67) 


41 


55 


61 


Obesity Brief (k = 8) 


8 


11 


100 


Obesity Comprehensive 
(k=108t) 


41 


55 


38 


LBP + CWP + Obesity Brief 
(k = 45t*) 


35 


47 


78 


LBP + CWP + Obesity 
Comprehensive (k= 1431"*) 


59 


80 


41 


Relevance threshold > 50% (m = 33) 








LBP Brief (k = 35) 


21 


64 


60 


LBP Comprehensive (k= 78) 


25 


76 


32 


CWP Brief (k = 24) 


17 


52 


71 


CWP Comprehensive (k = 67) 


26 


79 


39 


Obesity Brief (k = 8) 


7 


21 


88 


Obesity Comprehensive 
(k=108t) 


27 


82 


25 


LBP + CWP + Obesity Brief 
(k = 45t*) 


26 


79 


58 


LBP + CWP + Obesity 
Comprehensive (k= 1431"*) 


32 


97 


22 



Note: m = total number of ranked categories above the respective threshold; 
k = total number of categories in the respective ICF Core Set(s); t = categories 
aggregated on the second level; * = adjusted for overlap between the 
categories of the three ICF Core Sets. 



Study limitations 

Our study has some limitations. Our sample only included 
medical reports in German of the Swiss national disability 
insurance scheme with an ICD-10-diagnosis for CWP 
and/or LBP. The results may therefore not be generalizable 
to other health conditions, nor to other insurance 
schemes or other countries with different disability eva- 
luation procedures. Future research should involve valid- 
ation studies which look into the generalizability of our 
findings. 

Another limitation was the significant amount of con- 
tent not appropriately addressed in the current ICF tax- 
onomy. This refers mainly to some specific aspects of 
functioning related to work capacity (e.g. demanding ac- 
tivities) and to personal factors, which may influence 
work capacity [65] and could, when explicitly addressed, 
contribute to more transparent disability evaluations 
[66]. This limitation could have potentially missed fac- 
tors critical and relevant to the process of work capacity 
evaluation which should be taken into account in future 
research. 

Finally, one could argue that context-specific ICF-CS 
relevant to the field of work capacity evaluation, like the 
ones for vocational rehabilitation or the generic core set 
for disability evaluation in social security, may have been 
included in our analysis as well. However, as our sample 
included medical reports with the index conditions 
CWP and LBP, we decided to focus rather on condition- 
specific ICF-CS than on context-specific or generic ones. 
It might be an issue for further research to determine 
the extent to which these ICF-CS are representing the 
content of medical reports of disability claimants. 

Practical implications 

Combining ICF-CS (e.g. CWP with LBP and depres- 
sion, or LBP with CWP and obesity) is a more 
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effective approach for work capacity evaluations in- 
volving CWP and LBP than using solely condition- 
specific ICF-CS. Taken together, the ICF-CS show a 
potential for guiding comprehensive multidisciplinary 
assessments. In particular, they could ensure transpar- 
ency in disability evaluations as well as standardize 
them in terms of what should be documented. How- 
ever, efficiency and practicability become problematic 
when simply combining ICF-CS due to the high num- 
ber of categories to be assessed. To ensure high cover- 
age and efficiency, a suitable standard for medical 
work capacity evaluations involving CWP and LBP 
could include: 

(1) All categories of the Brief ICF-CS for the index 
conditions and major co-morbidities because 
Brief ICF-CS are considered as a minimum 
standard or data set to be reported in 
different settings so as to enhance 
comparability [35]; 

(2) Those categories of the Comprehensive ICF-CS 
identified as relevant for the present context; 

(3) Those categories not included in the ICF-CS but 
identified as relevant for the present context (e.g. 
b435 Immunological system functions for CWP 
reports; el65 Assets for LBP reports). 

Our relevance rankings display the categories which 
should be included in the standard. To ensure compre- 
hensive evaluations, we recommend to focus on categor- 
ies above the 25% threshold. Before being applied, 
however, future research would have to focus on a valid- 
ation of the categories by experts in the field of work 
capacity evaluation. 

Furthermore, the proposed ICF categories are the basis 
for a transparent documentation of those aspects of 
functioning which are relevant for a claimants work 
capacity and should be seen as a complement to the 
claimants diagnosis without necessarily having a di- 
rect implication on the work capacity decision itself. 
Whereas the categories can be used as a guideline 
for the evaluations in terms of what aspects should 
be documented, they are not addressing the issue of 
how these aspects should be assessed. This latter 
problem could be approached by assigning existing 
validated rating instruments to the suggested ICF 
categories. 

Last but not least, it is important to emphasize that 
aspects of functioning which refer to the unique individ- 
ual experience of a claimant, but are not necessarily 
addressed by the abovementioned ICF categories, should 
be considered in addition as complementary source of 
information to provide a comprehensive picture of the 
claimant. 



Conclusions 

The relevant content of medical work capacity evalua- 
tions involving CWP and LBP can be represented to a 
considerable extent by a combination of the ICF-CS for 
the index conditions and major co-morbidities. A suit- 
able approach for a standardized documentation of the 
evaluations and for enhancing their transparency could 
consist of the Brief ICF-CS, augmented by additional 
ICF categories relevant for this particular context. 
Aspects not appropriately addressed in the current ICF 
taxonomy, such as personal factors, should be specified 
and eventually incorporated in such a standard as well. 
In addition, the unique individual experiences of clai- 
mants have to be taken into account in order to assess 
work capacity comprehensively. 
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